JRM:jab 3/12/99 3382-5 1 039 Ml 9 1.1 



-30- 



E^^B Mail No. EL 1 2 1 36 1 055US 



We claim: 




fT A method fbr coding streaming media comprising a series of data units, the 
method comprising: 

classifying eafch of the data units in the series as one of the following types of 
encoded data units: in independent unit, a predicted unit, and a remotely predicted unit, 
such that the data units in the series are organized into segments, and each segment has 
an independent data/unit, two or more predicted units and at least one remotely predicted 
1 0 unit, wherein the independent data unit is a data recovery point and a random access point 
in the series of data units, and the remotely predicted unit is a data recovery point in the 
series of data units that is classified independently from the random access point and is 
coded with more efficiency than the independent data unit; 

encoding/each of the data units classified as an independent data unit in a 
1 5 compressed format using only information from the data unit; 

encoding each of the data units classified as a predicted unit in a compressed 
format by encoding differences between the data unit and the immediately preceding data 
unit in the series; and 

encoding each of the data units classified as a remotely predicted unit in a 
20 compressed format by encoding differences between the data unit and the data unit 
classified as the independent unit in the segment. 
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2. Tine method of claim 1 including: 

encoi ling the series of data units as a sequence of encoded data units comprising 
contiguous segments, each contiguous segment starting with an encoded independent 
lowed by predicted units that are each dependent on the immediately 
ta unit, and including at least one remotely predicted unit inserted within a 



data unit, fo 
preceding d 



oflt 



sequence ofjthe predicted units; 

wherein the classifying step is performed dynamically while previously classified 
and encoded data units are being transmitted. 
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3. The method of claim 2 wherein the classifying step includes 
dynamically selecting a spacing of remotely predicted units in each of the 
contiguous segments as the encoded data units are being transmitted. 



5 4. The method of claim 3 wherein the spacing of remotely predicted units is 

determined dynamically based on a priority assigned to media content being transmitted. 
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5. The method of claim 3 wherein the spacing of remotely predicted units is 
determined dynamically based on data transmission rate. 

6. The method of claim 3 wherein the spacing of remotely predicted units is 
dynamically determined based on a measure of data loss detected in previously 
transmitted data units. 

7. The method of claim 1 further including; 

encoding the series of data units as a sequence of encoded data units comprising 
contiguous segmepts, each contiguous segment starting with an encoded independent 
data unit, followed by predicted units that are dependent on the immediately preceding 
data unit, and including at least one remotely predicted unit inserted in a sequence of the 
predicted units such that the predicted unit immediately following the remotely predicted 
unit is predicted/ from the remotely predicted unit; 

prioritizing encoded data units for transmission such that independent data units 



are transmittec 
highest priority 

8. The 



with highest priority, remotely predicted units are transmitted with next 
and predicted units are transmitted with lowest priority. 



method of claim 7 wherein the series of data units is divided into portions, 
and the data units in each portion are prioritized such that all independent data units in a 
portion are to >e sent first, then all of the next highest priority data units, and finally all of 
the predicted units, subject to available bandwidth constraints. 
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9. The method of claim 1 wherein the data units are video frames. 
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10. The method of claim 1 wherein the data units are audio frames. 




1 1 . A computer readable medium having instructions for performing the steps of 



claim 1. 
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JZf A method for decoding streaming media comprising a series of data units 
where the data units are arranged in segments, and each segment includes an independent 
data unit, two or more predicted units and at least one remotely predicted unit, the 



method comprising: 
decoding an 



ncoded bit stream to identify the data units in the series for decoding 



as one of the following types of coded data units: an independent unit, a predicted unit, 
and a remotely predicted unit; 

for segments of independent data units in the series, decoding each of the 
segments, including: 

decoding each of the data units classified as an independent data unit in a 
compressed format/ using only information from the data unit; 



Ac 



decoding e^ch of the data units classified as a predicted unit by decoding 
differences between the data unit and the immediately preceding data unit in the series, 
and adding the differences with an immediately preceding data unit, which has been 
previously reconstructed and stored; and 



decoding 



;ach of the data units classified as a remotely predicted unit by decoding 



the segment, and 
previously recon< 1 



differences between the data unit and the data unit classified as the independent unit in 



adding the differences with the independent unit, which has been 
tructed and stored; and 
in an event where a predicted unit is lost, performing loss recovery with a 
remotely predicted unit following the lost predicted unit; 

wherein t le independent data unit is a data recovery point and a random access 
point in the serie > of data units, and the remotely predicted unit is a data recovery point in 
30 the series of data units that is inserted at a location that is independent from the random 
access point and is coded with more efficiency than the independent data unit. 
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13. A computer readable medium having instructions for performing the steps of 
claim 12. 

A rjaf^thc d for classifying data units in a media stream for prediction-based 
coding, the method comprising: 

reading an ordered sequence of data units in an input media stream; 
classifying each of the data units in the series as one of the following types of 
encoded data units: an independent unit, a predicted unit, and a remotely predicted unit, 
such that the data units in the series are organized into segments, and each segment has 
an independent data unit, two or more predicted units and two or more remotely predicted 
units, wherein the independent data unit is a data recovery point and a random access 
point in the series of data units, and the remotely predicted units are data recovery points 
in the series of data units that are classified independently from the random access point 



and are located c 



oser together in the series of data units than the independent data units; 



wherein € ach of the data units classified as an independent data unit is designated 
to be encoded us ng only information from the data unit; 

wherein t ach of the data units classified as a predicted unit is designated to be 
predicted from ai adjacent data unit in the series; and 

wherein e ach of the data units classified as a remotely predicted unit is designated 
to be predicted fiom a remote, non adjacent data unit in the series, which is either another 
remotely predicted unit or an independent data unit. 



yg? The method of claim < >5 / wherein each segment corresponds to a segment in 
an ordered sequence of segments in the input media stream; 

wherein e ich segment in the input media stream is a temporally ordered sequence 
of data units starting with a first data unit, and then followed by a temporally ordered 
sequence of data units; 

wherein the classifying step classifies the first data unit in each segment as an 
independent data unit, and classifies each data unit following the first data unit in the 
segment as a predicted unit or a remotely predicted unit. 
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\ZK The method of claim X5 \ 



The method of claim X§ wherein the remotely predicted units are classified 
dynamically duri ng transmission of previously encoded data units based on a measure of 
data transfer reli; ibility . 

J#T The method of claim J^r wherein the remotely predicted units are classified 
based on a measure of available bandwidth for transferring encoded data units. 



V9. The method of claim JXw 



>9^The method of claim J^wherein the remotely predicted units are classified 
based a user adjustable input parameter. 

& & 

J2£f. The method of claim ^Twherein the user adjustable parameter indicates 
spacing of remotely predicted units in independent segments. 

2^ The method of claiinj^ wherein the remotely predicted units are classified 
based on a user definable relationship between type of media content and spacing of the 
remotely predicted units in independent segments. 

<n 

?T The method of claim }6 wherein the remotely predicted units are classified 
based on a parameter returned by a receiver of the data stream that plays a decoded 
version of the data stream, where the parameter provides a measure of fidelity of the 
playback of the data stream. 

^ i i 

'q^l ^ e l 1 ^ 0 ^ °f claim Jo wherein the remotely predicted units are classified 

such that the series includes two or more levels of remotely predicted units, with a first 




level of remoteljj predicted units in a segment that are each directly dependent on an I 
unit of the segment, at least a second level of remotely predicted units in the segment, 



including a second level unit that is directly dependent on a unit in the first level. 

s2#^A computer readable medium having instructions for performing the steps of 



claim 
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2o\ A method for coding streaming media comprising a series of data units, the 
method comprising: 

classifying each of the data units in the series as one of the following types of 
encoded data units: an independent unit, a predicted unit, and a remotely predicted unit, 
such that the daja units in the series are organized into segments, and each segment has 
an independent /data unit, two or more predicted units and at least one remotely predicted 
unit, wherein the independent data unit is a data recovery point and a random access point 
in the series of lata units, and the remotely predicted unit is a data recovery point in the 
1 0 series of data u lits that is classified independently from the random access point and is 
coded with moie efficiency than the independent data unit; 

encodin i each of the data units classified as an independent data unit in a 
^ compressed for nat using only information from the data unit; 

Q encoding each of the data units classified as a predicted unit in a compressed 

1 5 format by enco ling differences between the data unit and an adjacent data unit in the 
H series; and 

in encoding each of the data units classified as a remotely predicted unit in a 

^ compressed for mat by encoding differences between the data unit and a remote, non- 

3 adjacent data unit in the segment, selected as either the independent unit or another 

II 20 remotely predicted unit in the segment. 

o y5. A method for coding streaming media comprising a series of data units, the 

method comprising: 

classifying each of the data units in the series as one of the following types of 

25 encoded data units: an independent unit, a predicted unit, and a remotely predicted unit, 
such that the data units in the series are organized into segments, and each segment has 
an independent data unit, two or more predicted units and two or more remotely predicted 
units, wherein the independent data unit is a data recovery point and a random access 
point in the series of data units, and the remotely predicted units are data recovery points 

30 in the series of data units that are classified independently from the random access point 
and are located closer together in the series of data units than the independent data units; 
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encoding each of the data units classified as an independent data unit in a 
compressed format using only information from the data unit; 

encoding each of the data units classified as a predicted unit in a compressed 
format by encoding differences between the data unit and an adjacent data unit in the 
series; 

encoding each of the data units classified as a remotely predicted unit in a 
compressed format by encoding differences between the data unit and a remote, non- 
adjacent data unit in the segment, selected as either the independent unit or another 
remotely predicted unit in the segment; and 

prioritizing encoded data units for transmission such that independent data units 
are transmitted with highest priority, remotely predicted units are transmitted with next 
highest priority, and predicted units are transmitted with lowest priority. 





